Auto-Weighted Layer Representation Based View Synthesis Distortion Estimation for 3-D Video Coding

نویسندگان

چکیده

Recently, various view synthesis distortion estimation models have been studied to better serve 3-D video coding. However, they can hardly model the relationship quantitatively among different levels of depth changes, texture degeneration, and (VSD), which is crucial for rate-distortion optimization rate allocation. In this paper, an auto-weighted layer representation based developed. Firstly, sub-VSD (S-VSD) defined according level changes their associated degeneration. After that, a set theoretical derivations demonstrate that VSD be approximately decomposed into S-VSDs multiplied by weights. To obtain efficiently, layer-based method developed, where all pixels with same are represented layer. It enables S-VSD calculation at level. Meanwhile, nonlinear mapping function learnt accurately represent between S-VSDs, automatically providing weights during estimation. learn such function, dataset its built, termed as VSDSet. Experimental results show estimated once available. The proposed outperforms relevant state-of-the-art methods in both accuracy efficiency. VSDSet source code will available https://github.com/jianjin008/.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Depth Estimation for View Synthesis in Multimedia Video Coding

The compression of multiview video in an end-to-end 3D system is required to reduce the amount of visual information. Since multiple cameras usually have a common field of view, high compression ratios can be achieved if both the temporal and inter-view redundancy are exploited. View synthesis prediction is a new coding tool for multiview video that essentially generates virtual views of a scen...

متن کامل

Rate - Distortion - Optimized Video Coding Using a 3 - D

| Model-based video synthesis is combined with block-based motion-compensated video coding for rate-distortion eecient transmission of head-and-shoulder sequences. Two frames are utilized for block-based motion-compensated prediction of the current video frame where one frame is the previously reconstructed one and the other frame is provided by a model-based coder. The model-based coder uses a...

متن کامل

View synthesis prediction for multiview video coding

We propose a rate-distortion-optimized framework that incorporates view synthesis for improved prediction in multiview video coding. In the proposed scheme, auxiliary information, including depth data, is encoded and used at the decoder to generate the view synthesis prediction data. The proposed method employs optimal mode decision including view synthesis prediction, and sub-pixel reference m...

متن کامل

Overview of View Synthesis Prediction for Multi-view Video Coding

With a wide range of viewing angles, the multi-view video can provide more realistic feeling at arbitrary viewpoints. However, because of a huge amount of data from multiple cameras, we need to develop an efficient coding method. One of the promising approaches for multi-view video coding is view synthesis prediction which generates an additional reference frame. In this paper, we explain the p...

متن کامل

Depth map coding with distortion estimation of rendered view

New data formats that include both video and the corresponding depth maps, such as multiview plus depth (MVD), enable new video applications in which intermediate video views (virtual views) can be generated using the transmitted/stored video views (reference views) and the corresponding depth maps as inputs. We propose a depth map coding method based on a new distortion measurement by deriving...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Multimedia

سال: 2022

ISSN: ['1520-9210', '1941-0077']

DOI: https://doi.org/10.1109/tmm.2022.3199102